Video display control methods and apparatuses and display devices

ABSTRACT

Various video display control methods and apparatuses and various display devices are provided. A method comprises: acquiring interframe differences between every two adjacent frames in at least two adjacent video frames in sequence of a video, adjusting a local display image distance of at least one video frame in the at least two video frames according to respective interframe differences, and controlling the display device to display a local of the at least one video frame at least according to the local adjusted display image distance of the at least one video frame. A visual effect and user experience can thereby be improved.

RELATED APPLICATION

The present application claims the benefit of priority to Chinese PatentApplication No. 201510290798.2, filed on May 30, 2015, and entitled“Video Display Control Methods and Apparatuses and Display Devices”,which application is hereby incorporated into the present application byreference herein in its entirety.

TECHNICAL FIELD

The present application relates to the technical field of display, and,for example, to various video display control methods and apparatusesand various display devices.

BACKGROUND

With continuous development of display technologies, types of displaydevices are developed continuously, for example, continuous developmentof novel display devices such as a 3D display, a near-to-eye displaydevice and a light field display, and diversified applicationrequirements are met.

In certain situations, difference of different video frames comprised ina video affects a visual effect of its displayed content, for example,difference of different video frames possibly causes phenomena such as astuck screen, lag, judder, and trailing during video display of thedisplay device, and a poor visual effect is caused.

SUMMARY

The following briefly describes the present application, so as toprovide a basic understanding of some aspects of the presentapplication. It should be understood that, the brief description is notan exhaustive brief description of the present application. Thedescription is neither intended to determine key or important parts ofthe present application, nor intended to limit the scope of the presentapplication. An objective thereof is merely to give some concepts in asimplified manner as a preface for more detailed descriptionhereinafter.

The present application provides various video display control methodsand apparatuses and various display devices.

In a first aspect, an example embodiment of the present applicationprovides a video display control method, comprising:

acquiring interframe differences between every two adjacent frames in atleast two adjacent video frames in sequence of a video;

adjusting a display image distance of a part of at least one video framein the at least two video frames according to respective interframedifferences; and

controlling a display device to display the part of the at least onevideo frame at least according to the adjusted display image distance ofthe at least one video frame.

In a second aspect, an example embodiment of the present applicationfurther provides a video display control apparatus, comprising:

an interframe difference acquiring module, configured to acquireinterframe differences between every two adjacent frames in at least twoadjacent video frames in sequence of a video;

a display image distance adjusting module, configured to adjust adisplay image distance of a part of at least one video frame in the atleast two video frames according to respective interframe differences;and

a first display control module, configured to control the display deviceto display the part of the at least one video frame at least accordingto the local adjusted display image distance of the at least one videoframe.

In a third aspect, an example embodiment of the present application alsoprovides a near-to-eye display device, comprising:

a processor, a communication interface, a memory and a communicationbus; the processor, the communication interface and the memorycommunicate with one another by the communication bus;

the memory is configured to store at least one command; the commandcauses the processor to perform following operations:

acquiring interframe differences between every two adjacent frames in atleast two adjacent video frames in sequence of a video;

adjusting a display image distance of a part of at least one video framein the at least two video frames according to respective interframedifferences; and

displaying the part of the at least one video frame at least accordingto the adjusted display image distance of the at least one video frame.

According to the technical solutions provided by one or more embodimentsof the present application, association between an interframe differencebetween at least two adjacent video frames and a display image distanceof the video frame in a video is established, the display image distanceof the corresponding video frame is pertinently adjusted at leastaccording to the interframe difference, and the part of thecorresponding video frame is displayed at least according to theadjusted display image distance, thereby a visual effect and userexperience are improved.

The following describes in detail alternative embodiments of the presentapplication with reference to accompanying drawings, to make these andother advantages of the present application more obvious.

BRIEF DESCRIPTION OF THE DRAWINGS

The present application may be understood better with reference to thefollowing description in combination with accompanying drawings, whereina same or similar accompanying drawing mark is used in all theaccompanying drawings to represent a same or similar component. Theaccompanying drawings together with the following detailed descriptionare comprised in the specification and constitute a part of thespecification, and are used to further illustrate alternativeembodiments of the present application and explain the principle andaspects of the present application. In the accompanying drawings:

FIG. 1 is a flowchart of a video display control method according to anexample embodiment of the present application;

FIG. 2 is a logical block diagram of a first video display controlapparatus according to an example embodiment of the present application;

FIG. 3 is a logical block diagram of a second video display controlapparatus according to an example embodiment of the present application;

FIG. 4 is a logical block diagram of a third video display controlapparatus according to an example embodiment of the present application;

FIG. 5 is a logical block diagram of a display device according to anexample embodiment of the present application.

A person skilled in the art should understand that, elements in theaccompanying drawings are merely shown for simplicity and clarity, andare not necessarily drawn to scale. For example, in the accompanyingdrawings, the size of an element may be enlarged relative to anotherelement, so as to facilitate enhancing an understanding of theembodiments of the present application.

DETAILED DESCRIPTION

The following will describe in details illustrative embodiments of thepresent application with reference to accompanying drawings. For thepurpose of clear and brief description, the specification does notdescribe all features of practical example embodiments. However, itshould be understood that, many decisions specific to the exampleembodiments must be made during development of any one of the practicalembodiments, so as to achieve a specific objective of a developer, forexample, conformance to restrictive conditions related with a system andservice, wherein the restrictive conditions may vary with differentimplementation manners. In addition, it should also be understood that,although development work may be very complex and time-consuming, for aperson skilled in the art that benefits from the content of the presentdisclosure, the development work is only a routine task.

Another point that should be noted here is, to avoid the presentapplication from being not clearly understood due to unnecessarydetails, the accompanying drawings and specification merely describeapparatus structures and/or processing steps closely related to thesolutions of the present application, but omit the representation anddescription of parts and processing that have little relation with thepresent application, and have been known by a person of ordinary skillin the art.

The following further describes in detail example embodiments of thepresent application with reference to the accompanying drawings (a samelabel represents a same element in several accompanying drawings) andembodiments. The following embodiments are used to describe the presentapplication, but are not intended to limit the scope of the presentapplication.

A person skilled in the art may understand that, terms such as “first”and “second” in the present application are merely used to distinguishdifferent steps, devices or modules, which neither represent anyspecific technical meaning, nor represent a necessary logic sequenceamong them.

FIG. 1 is a flowchart of a video display control method according to anembodiment of the present application. The video display control methodprovided by this embodiment of the present application may be executedby certain video display control apparatus, and the video displaycontrol apparatus can perform display control by executing the videodisplay control method, comprising but not limited to before or duringvideo display. There is no limit to the manners in which the videodisplay control apparatus is embodied. For example, the video displaycontrol apparatus may be an independent part, and the part cooperateswith a display device in communication; or the video display controlapparatus may be a functional module integrated in a display device,etc., which is not limited in this embodiment of the presentapplication.

Specifically, as shown in FIG. 1, a video display control methodprovided by this embodiment of the present application comprises:

S101: Acquiring interframe differences between every two adjacent framesin at least two adjacent video frames in sequence of a video;

S102: Adjusting a local display image distance of a part of at least onevideo frame in the at least two video frames according to respectiveinterframe differences; and

S103: Controlling the display device to display the part of the at leastone video frame at least according to the local adjusted display imagedistance of the at least one video frame.

The inventor of the present application found during implementation ofthis embodiment of the present application that for a video to bedisplayed, display image distances of respective video frames comprisedin the video generally adopt default display image distances, anddisplay image distances of different video frames are basically same.However, in certain conditions, certain video may comprise multiplescenes with large differences, or certain video may have related contentof movement information of one or more display objects, and the like,which causes the interframe difference between two adjacent video framesin the video to be overlarge, for example, two different video framesrespectively correspond to contents of different scenes, or, the samedisplay object in the two adjacent video frames has overhigh movementspeed, etc. In these situations, limited to reasons such as dataprocessing capacity, of the video display control apparatus and splitvision persistence of a display device, phenomena such as a stuckscreen, lag, judder, and trailing during video display of the displaydevice may occur during video display, and a visual effect of a user ispoor.

Research shows that in terms of visual features of eyes, the eyes arerelatively sensitive to display content closer to the eyes and areinsensitive to the display content farther away from the eyes. Forexample, for the same display detail of the display content, the displaycontent is respectively displayed at a first position closer to the eyesand a second position farther away from the eyes, the visual resolutionof the eyes to the detail of the display content at the first positionis higher than the visual resolution of the eyes to the detail of thedisplay content at the second position. Considering this, according tothe technical solutions provided by embodiments of the presentapplication, association between an interframe difference between atleast two adjacent video frames and a local display image distance ofthe video frame in a video is established, the display image distance ofthe part of the corresponding video frame is pertinently adjusted atleast according to the interframe difference, and the part of thecorresponding video frame is displayed at least according to theadjusted display image distance, thereby a visual effect and userexperience are improved.

For example, in the technical solution provided by the embodiment of thepresent application, by a display manner of increasing a local displayimage distance of a corresponding video frame, uncomfortable visualperception of the user possibly caused by the overlarge local interframedifference of adjacent video frames can be weakened to certain extent,that is to say, the visual perception of the eyes to display effectssuch as a stuck screen, lag, judder or trailing possibly caused by theoverlarge local interframe difference of the adjacent video frames isweakened to certain extent by adjusting the display image distance,thereby a visual effect and user experience are improved.

For another example, in the technical solution provided by theembodiment of the present application, by a display manner of reducing alocal display image distance of a corresponding video frame, animmersive visual effect and experience of the user to the contentdisplayed by the display device in situations with smaller interframedifference and the like can be adjusted.

The display image distance of any video frame is the distance between animage of the video frame through an optical part of the display deviceand the optical part. Before adjusting, the display image distances ofdifference parts of the same video frame are generally same, after thedisplay image distance is adjusted by adopting the technical solutionprovided by the embodiment of the present application, the display imagedistances corresponding to different parts in the same video frame maybe different, in the video display process of the display device, andoptical parameters of the display device are adjusted to match with thedisplay image distances of different parts of the video frame. Theadjustment of local display image distance of certain video frame isequivalent to the adjustment of the distance between the local image ofthe video frame displayed by the display device and the eyes, comprisingbut not limited to increasing or reducing of an original display imagedistance to meet diversified practical application demands. The displayimage distance can be flexibly adjusted, for example: the display imagedistances of different parts in the video frame can be changed byadjusting optical parameters of the display device, the opticalparameters comprise but are not limited to focus length and/orrefractive index of the optical part; for another example, by contentpretreatment of different parts of the video frame, the content ofdifferent parts of the video frame is displayed to refocusing planes ofdifferent depths, for example, displayed to the refocusing plane of thedepth corresponding to the display image distance of different parts ofthe video frame; for another example, the display device can comprisedifferent waveguide layers distributed along the depth direction,different waveguide layers are configured to reconfigure light fieldinformation of different depths of planes, each waveguide layercomprises a plurality of light splitters and a miniaturized micro curvereflector, incident light images after transmission of the waveguidelayers, which is equivalent to rebuilding of light field information ofthe corresponding video frame on one specific depth plane, by changingthe waveguide layers for transmitting imaging light of different partsof the video frame, light field information of corresponding parts ofthe video frame can be reconfigured on different depths, therebydifferent parts of the video frame are displayed by adopting pertinentdisplay image distances.

In the technical solution provided by the embodiment of the presentapplication, at least one video frame in the at least two video framescomprises any video frame in the at least two video frames. Optionally,the at least one video frame in the at least two video frames comprises:at least one former video frame in the at least two video frames and/orat least one latter video frame in the at least two video frames. Theformer video frame and the latter video frame are relative concepts, forthe N (N is an integer larger than 1) continuously distributed videoframes in the video, besides the last video frame in the N video frames,other respective video frames can form the former video frame in certainsituations, similarly, besides the first video frame in the N videoframes, other respective video frames can form the latter video frame incertain situations, for example, for the two adjacent video frames insequence, the first video frame is the former video frame, and thesecond video frame is the latter video frame.

The at least two adjacent video frames in sequence in a video cancomprise the situation of two adjacent video frames in the video andalso comprise the situation of three adjacent video frames in sequenceor more than three video frames in the video. In a practical applicationprocess, the interframe difference between every two adjacent videoframes in respective video frames comprised in certain time window canbe determined by a time window sliding-similar manner according to timesequence, and a display image distance of at least one frame in the atleast two video frames is determined according to respective interframedifferences. For example, for N adjacent video frames {1, 2 . . . N−2,N−1, N} in sequence in a video, the interframe differences □_(1,2),□_(2,3) . . . □_(N-2,N-1), □_(N-1,N) between every two adjacent videoframes in the N video frames are respectively calculated, the displayimage distance of certain video frame can be adjusted according to oneor more determined interframe differences, for example, the display magedistance of the first video frame can be adjusted according to theinterframe difference □_(1,2) between the first and second video frames,and can also be adjusted according to a content change tendencyreflected by the multiple interframe differences □_(1,2), □_(2,3) . . .□_(N-2,N-1), □_(N-1,N), etc., and a realizing manner is very flexible.

After certain local adjusted display image distance of the at least onevideo frame is determined, the display device is controlled to displaythe part of the at least one display object at least according to thelocal adjusted display image distance of the at least one video frame.Optionally, controlling the display device to display the part of the atleast one video frame at least according to the local adjusted displayimage distance of the at least one video frame comprises: controllingthe display device to display the part of the at least one video framein a zooming manner at least according to the local adjusted displayimage distance of the at least one video frame. In the solution,adjustment of the display image distance in a depth direction ofdifferent parts of the video frame and the zooming display of thecontent of corresponding part of the video frame are combined, which isfavorable for fully using visual features of the eyes to reduce as muchas possible or eliminate the eye visual discomfort caused by displaychange in the depth direction.

Specifically, adjustment of the display image distance is equivalent tothe increment or reduction of a display distance in the depth direction,if the change of the local display image distance of the correspondingvideo frame is small or the user does not mind the eye visual discomfortcaused by the display change and the like, the part of the correspondingvideo frame is displayed according to the adjusted display imagedistance. But, in certain situation, further adjustment is required torelieve or even eliminate the eye visual discomfort possibly caused bychange of the display image distance, for example, if change of thelocal display image distance of the corresponding video frame is larger,or the eye visual discomfort caused by the change of the display imagedistance is hoped to be reduced as much as possible in practicalapplication, optionally, zooming display of content of the correspondingvideo frame is combined for visual feeling adjustment, to cause eyes ofthe user to not see such change in the depth direction as much aspossible, thereby the eye visual discomfort caused by the display changein the depth direction is weakened as much as possible or eliminated.

Optionally, the local adjusted display image distance of the at leastone video frame is larger than the display image distance beforeadjusting, the controlling the display device to display the part of theat least one video frame in a zooming manner at least according to thelocal adjusted display image distance of the at least one video framecomprises: controlling the display device to display the part of the atleast one video frame in a zooming in manner at least according to thelocal adjusted display image distance of the at least one video frame.In the solution, the part farther display of the at least one videoframe and the local zooming in display are combined, on one aspect, theeye visual discomfort possibly caused by the overlarge local interframedifference of every two adjacent video frames is weakened or even offsetby a manner of farther display of the part of the at least one videoframe, on the other aspect, by using a near-large-far-small eye visualfeature, by zooming in display of the visual effect, that the at leastone video frame is closer to the eyes, caused to the eyes, visualperception of the eyes in the depth direction caused by actual fartherdisplay of the part of the at least one video frame is relieved tocertain extent or even offset, thereby the visual discomfort possiblycaused by the adjusting of the local display image distance of the videoframe is relieved or even eliminated, and further it is favorable forimproving visual effect and user experience.

Optionally, the local adjusted display image distance of the at leastone video frame is smaller than the display image distance beforeadjusting, the controlling the display device to display the part of theat least one video frame in a zooming manner at least according to thelocal adjusted display image distance of the at least one video framecomprises: controlling the display device to display the part of the atleast one video frame in a zooming out manner at least according to thelocal adjusted display image distance of the at least one video frame.In the solution, the local closer display of the at least one videoframe and the local zooming out display are combined, on one aspect, avisual immersing feeling of the corresponding video frame contentdisplayed by the display device is increased in a manner of closerdisplay of the part of the at least one video frame, and visual effectand user experience are improved, on the other aspect, by using anear-large-far-small eye visual feature, by zooming out display of thevisual effect, that the at least one video frame is farther away fromthe eyes, caused to the eyes, the visual perception of the eyes in thedepth direction caused by actual closer display of the part of the atleast one video frame is relieved to certain extent or even offset,thereby the visual discomfort possibly caused by the adjusting of thedisplay image distance is relieved or even eliminated, and further it isfavorable for improving the visual effect and user experience.

Optionally, the controlling the display device to display the part ofthe at least one video frame in a zooming manner at least according tothe local adjusted display image distance of the at least one videoframe comprises: determining a local zooming ratio parameter of the atleast one video frame according to the display image distance before andafter local adjusting of the at least one video frame; and controllingthe display device to display the part of the at least one video frameaccording to the local adjusted display image distance of the at leastone video frame and the zooming ratio parameter. In the solution, thezooming ratio parameter of the local display of the video frame isdetermined in combination with the display image distance before andafter local adjusting of the video frame, and zooming display control isperformed accordingly, thereby, the visual discomfort possibly caused bythe adjusting of the display image distance is relieved or eveneliminated, and it is favorable for improving visual effect and userexperience.

A pixel pitch of the display device is assumed as p_(d), the distancebetween an image of a local display object of certain video framedisplayed through the display device in space and the eyes is d_(o1),the multiplying times of the same display pixels on the plane of theimage is M¹, if the number of the display pixels corresponding to adisplay object is S₁, in certain situations, for example, the situationthat the at least two adjacent video frames in sequence comprise thesame display object, for a user, in order to guarantee that the imagesof the same display object on eye retinas are consistent in size, thenit requires to meet:p _(d) S ₁ M ₁ =p _(d) S ₂ M ₂  (1)

-   -   wherein,

${M_{1} = {1 + \frac{d_{o\; 1} - d_{e}}{f_{1}}}},{M_{2} = {1 + \frac{d_{o\; 2} - d_{e}}{f_{2\;}}}},$

-   -    S₂ is the number of display pixels corresponding to the display        object after the display image distance of the corresponding        video frame is adjusted, and the multiplying times of the same        display pixels on the plane where the image of the display        object of the corresponding video frame after the display image        distance is positioned is M₂. Through formula transformation, a        zooming ratio parameter R_(m) is:

$\begin{matrix}{R_{m} = {\frac{s_{2}}{s_{1}} = \frac{f_{2}\left( {f_{1} + d_{o\; 1} - d_{e}} \right)}{f_{1}\left( {f_{2} + d_{o\; 2} - d_{e}} \right)}}} & (2)\end{matrix}$

The solution is adopted to determine the zooming ratio parameter ofdisplay of a display object of corresponding video frame and performdisplay control accordingly, which is favorable for compensating a uservisual effect caused by the adjusting of the display image distancethrough using the eye near-large-far-small visual feature, thereby it isfavorable for relieving or even eliminating the visual perception of theuser in the depth direction possibly caused by the adjusting of thedisplay image distance, and improving the visual effect and userexperience.

In a practical application process, respective interframe differencescan be compared with certain preset condition respectively, anddifferent strategies for adjusting the local display image distance ofthe corresponding video frame can be adopted according to a comparisonresult, to improve universality and flexibility of the solution.

Optionally, the adjusting the local display image distance of at leastone video frame in at least two video frames according to the respectiveinterframe differences comprises: adjusting, responding to therespective interframe differences to meet one preset conditionrespectively, the local display image distance of the at least one videoframe to cause the local adjusted display image distance of the at leastone video frame to be larger the display image distance beforeadjusting. The respective local interframe differences between every twoadjacent video frames in at least two adjacent video frames in sequencein a unit time window can reflect the change tendency of the videocontent in the time window along with time to certain extent. Ifrespective interframe differences meet the preset condition, it isindicated that the change tendency of the video content in the timewindow along with time is relatively stable, then the local displayimage distance of the at least one video frame is adjusted to cause thelocal display image distance of the at least one video frame to belarger than the display image distance before adjusting. The solution isequivalent to that in a practical display process, the part ofcorresponding video frame is displayed at certain position farther awayfrom the display image distance before adjusting, thereby by using thefeature that the eyes have lower visual resolution for a farther displaycontent, the uncomfortable perception possibly caused when the eyes seethe corresponding video frame is weakened, thereby a viewing effect anduser experience are improved. If the at least one interframe differencein respective interframe differences does not meet the preset condition,then it is indicated that the change tendency of the video content inthe time window along with time is not stable, then the local displayimage distance of the corresponding video frame is not adjusted, therebythe eye visual discomfort possibly caused by the frequent adjusting ofthe display image distances of different video frames in a period oftime is avoided.

In the technical solution provided by the embodiment of the presentapplication, the local interframe difference between any two adjacentvideo frames shows difference degree of the display contentcorresponding to the two adjacent video frames, in a practicalapplication process, different parameters can be selected to show theinterframe difference as required, which is not limited by thisembodiment of the present application.

(1) Optionally, the interframe difference between any two adjacent videoframes in the at least two video frames comprises: optical parameterdifference of pixels at multiple corresponding positions in the twoadjacent video frames; and correspondingly, the part of the at least onevideo frame comprises: at least one region, in which pixels with theoptical parameter difference exceeding an optical parameter thresholdare distributed, in a video frame. The pixels at the correspondingpositions in the two adjacent video frames comprise but are not limitedto the pixels corresponding to same positions or same index numbers inthe two adjacent video frames, the optical parameter difference of thepixels at respective corresponding positions reflects the interframedifference between the two adjacent video frames to certain extent, andthe optical parameter difference is easier to capture and quantify,thereby, realizing complexity of the solution is favorably reduced.

Optionally, the optical parameters comprise at least one of following:brightness, chroma, and saturation degree; change of the brightness,chroma, and/or saturation degree can better reflect the interframedifference of two adjacent video frames. A preset condition based on theoptical parameter difference and used for triggering a local displayimage distance determining strategy is determined according to actualdemands, which is not limited in this embodiment of the presentapplication, optionally, the preset condition comprises at least one offollowing:

(11) A pixel number of the optical parameter difference exceeding anoptical parameter threshold is smaller than a pixel number threshold.

(12) A first specific value of the pixel number of the optical parameterdifference exceeding an optical parameter threshold to the total numberof the single frame pixels is smaller than a pixel ratio threshold.

(13) A non-continuously distributed region number of pixels of theoptical parameter difference exceeding an optical parameter threshold issmaller than a region number threshold.

(14) A continuously distributed maximal region area of the pixels of theoptical parameter difference exceeding an optical parameter threshold issmaller than an area threshold.

(15) A second specific value of the continuously distributed maximalregion area of the pixels of the optical parameter difference exceedingan optical parameter threshold to a single frame total area is smallerthan an area ratio threshold.

Above respective preset conditions can be independently usedrespectively, and can be combined for use to better capture and quantifythe interframe difference of two adjacent video frames, and a realizingmanner is very flexible. Specifically, the optical parameter differencecomprises but is not limited to brightness difference, chroma differenceand/or saturation degree difference. The brightness difference of thecorresponding positions of the two adjacent video frames reflects theTemporal Perceptual Information (TI) of the video, a reason of thebrightness difference of the corresponding positions of the two adjacentvideo frames comprises but is not limited to at least one of following:content difference of the corresponding positions of the two adjacentvideo frames, damage to the video content caused by a network factor,etc., which is not limited in this embodiment of the presentapplication, the damage to the video content caused by the networkfactor comprises but is not limited to incomplete transmission orreceiving of the content corresponding to the video frame, and the like.The following takes the brightness difference as an example fordescription, and a realizing manner of other optical parameterdifferences is similar and is not repeated herein.

For example, a preset condition comprises: a pixel number of thebrightness difference exceeding a bright threshold value is smaller thana pixel number threshold. In terms of two adjacent video frames,brightness of the pixels of the same index numbers or same positions ofthe two adjacent video frames can be compared to obtain the brightnessdifference of respective corresponding pixels of the two adjacent videoframes; the continuous difference corresponding to respective pixels iscompared with the brightness threshold to determine the pixel number ofthe brightness difference exceeding the brightness threshold; then thepixel number and the pixel number threshold are compared, if the pixelnumber is smaller than the pixel number threshold, then the brightnessdifference between the two adjacent video frames meets the presetcondition, and it is indicated to some extent that the probability thatthe two adjacent video frames have only larger local difference islarger; otherwise, the brightness difference between the two adjacentvideo frames does not meet the preset condition, and it is indicated tosome extent that the probability that the two adjacent video frames havelarger whole difference is larger. In the solution, the interframedifference between two adjacent video frames is reflected by countingthe pixel number of the optical parameters such as the brightness,therefore, time complexity between the two video frames is betterreflected to correspondingly adjust the local display image distance ofthe video frame, and the solution is easy to realize.

For another example, the preset condition comprises: a first specificvalue of the pixel number of the brightness difference exceeding abrightness threshold to the single pixel total number is smaller than apixel ratio threshold. In terms of any two adjacent video frames, thepixel number of the brightness difference exceeding a brightnessthreshold in the two adjacent video frames can be acquired to determinea specific value of the pixel number to the single frame pixel totalnumber (called as a first specific value), the first specific value iscompared with the pixel threshold, if the first specific value issmaller than the pixel ratio threshold, it is indicated to some extentthat the probability that the two adjacent video frame have only largerlocal difference is larger; otherwise, the brightness difference betweenthe two adjacent video frames does not meet the preset condition and itis indicated to some extent that the probability that the two adjacentvideo values have larger whole difference is larger.

For another example, the preset condition comprises: a non-continuouslydistributed region number of pixels of the brightness differenceexceeding a brightness threshold is smaller than a region numberthreshold. In terms of two adjacent video frames, the pixels of thebrightness difference exceeding a brightness threshold in the twoadjacent video frames can be acquired, according to the fact whether thespatial positions of the different pixels are adjacent or not, adistribution condition of these pixels can be determined, the regionwhere the multiple pixels with adjacent spatial positions are isregarded as a continuously distributed region of a part of pixels,viewed as a whole, the continuously distributed region number of themultiple parts of pixels is equivalent to the non-continuouslydistributed region number of the pixels of the brightness differenceexceeding the brightness threshold. Then, the non-continuouslydistributed region number of the pixels of the brightness differenceexceeding the brightness threshold is compared with the region numberthreshold, if the non-continuously distributed region number of thepixels of the brightness difference exceeding a brightness thresholdexceeds the region number threshold, the preset condition is met, and itis indicated to some extent that the probability that the two adjacentvideo frames have only larger local difference is larger; otherwise, thepreset condition is not met and it is indicated to some extent that theprobability that the two adjacent video frames have larger wholedifference is larger. In the solution, a distribution condition that thepixels of the brightness difference exceeding a brightness threshold isused as a judgment factor, and it is favorable to improve the judgingaccuracy of the interframe difference of the two adjacent video frames.

For another example, the preset condition comprises: the continuouslydistributed maximal region area of the pixels of the brightnessdifference exceeding a brightness threshold value is smaller than anarea threshold. In terms of two adjacent video frames, continuouslydistributed respective regions of the pixels of the brightnessdifference exceeding a brightness threshold in the two adjacent videoframes can be acquired, the maximal region area is determined, and iscompared with the area threshold, if the maximal region area is smallerthan the area threshold, the preset condition is met, and it isindicated to some extent that the pixels are distributed in a relativelyconcentrated manner, and the probability that the two adjacent videoframes have only larger local difference is larger; otherwise, thepreset condition is not met, it is indicated to some extent that thepixels are distributed in a relatively dispersed manner, and theprobability that the two adjacent video frames have whole difference islarger. In the solution, the continuously distributed maximal regionarea of the pixels of the brightness difference exceeding a brightnessthreshold is used as a judgment factor, and it is favorable to improvethe judging accuracy of the interframe difference of the two adjacentvideo frames.

For another example, the preset condition comprises: a second specificvalue of the continuously distributed region area of the pixels of thebrightness difference exceeding a brightness threshold to a single frametotal area is smaller than an area ratio threshold. In terms of twoadjacent video frames, the continuously distributed maximal region areaof the pixels of the brightness difference exceeding the brightnessthreshold in the two adjacent video frames can be acquired, the specificvalue (called as a second specific value) of the maximal region areaaccounting for the distributed total area of respective single framepixels is determined, the second specific value is compared with thearea ratio threshold, if the second specific value exceeds the arearatio threshold, the preset condition is met, and it is indicated tosome extent that the two adjacent video frames have a smaller proportionof areas with continuous difference and that the probability that thetwo adjacent video frames have only larger local difference is larger;otherwise, the preset condition is not met, and it is indicated to someextent that two adjacent video frames have a small proportion of areaswith continuous difference and that the probability that the twoadjacent video frames have larger whole difference is larger. In thesolution, an area proportion of the continuously distributed maximalregion area of the pixels of the brightness difference exceeding abrightness threshold is used as a judgment factor, and it is favorableto improve the judging accuracy of the interframe difference of the twoadjacent video frames.

If the time window comprises three or more than three video frames, theabove method can be adopted to respectively determine whether thebrightness difference between every two adjacent video frames meets theone or more preset conditions, and a corresponding display imagedistance adjusting strategy is adopted according to a determiningresult, for example, the respective brightness differences between theevery two adjacent video frames respectively meet the correspondingpreset conditions, the local display image distance of at least onevideo frame can be increased, namely only the local display imagedistance of the at least one video frame is adjusted, to weaken thevisual perception of the eyes to the part of the video frames withoverlarge brightness difference by a manner of farther display of thepart of the corresponding video frames, and the realizing complexity ofthe solution is reduced as much as possible by a manner of adjusting alocal display image distance of the video frame; and/or, at least one ofthe brightness differences between every two adjacent video frames doesnot meet the corresponding preset condition, the display image distanceof the at least one video frame is kept unchanged to avoid the eyevisual discomfort possibly caused by the frequent display image distanceadjusting, or the display image distance of the at least one video framecan be properly reduced to increase a visual immersion of the user tothe corresponding display content of the at least one video frame, orthe whole display image distance of the at least one video frame isadjusted by taking the video frame as a unit to improve the adjustingefficiency of the display image distance; etc.

(2) Optionally, the interframe difference between any two adjacent videoframes in the at least two video frames comprises: displacement of theat least one display object between the two adjacent video frames,correspondingly, the part of the at least one video frame comprises: theat least one display object in the at least one video frame. Thedisplacement of the same display object between the two adjacent videoframes reflects the movement information of the display object, if thedisplacement is larger, it is indicated to some extent that the movementof the display object in a refreshing time period of the two videoframes is faster, otherwise, if the displace is smaller or even zero, itis indicated to some extent that the movement of the display object in arefreshing time period of the two video frames is slower or evenrelatively still. In the solution, through the displacement of the samedisplay object between the two adjacent video frames, the local movementinformation of the display object (for example, certain display object)is convenient to capture and quantify, thereby realizing complexity ofthe solution is favorably reduced. A preset condition based on themovement information difference such as displacement and used fortriggering a display image distance determining strategy is determinedaccording to actual demands, which is not limited in this embodiment ofthe present application, optionally, the preset condition comprises atleast one of following:

(21) the preset condition comprises: expected refreshing informationcorresponding to displacement exceeds the refreshing capacityinformation of the display device. In the solution, movement informationof a display object and the refreshing capability information arecombined to adapt to the display image distance of the same displayobject at different video frames, and improve adjusting pertinence andeffectiveness of the display image distance.

The refreshing capability information of the display device can be shownby a refreshing rate or period of the display device, if the displaydevice has multiple refreshing rates or periods, any one refreshing rateor period (for example the currently arranged refreshing rate or periodof the display device) can be adopted to show the refreshing capabilityinformation of display device, or, the highest refreshing rate orshortest refreshing period can be adopted as the refreshing capabilityof the display device, which is specifically determined according toapplication demands and is not limited in this embodiment of the presentapplication. An image of the display object through the display devicecan be positioned on a display scene of the display device, or, atcertain position in front of or behind the display screen of the displaydevice.

The displacement of certain display object between two adjacent videoframes is assumed as s₀, and the displacement of unit time is movementspeed v of the display object. Usually, relative displacement s_(d) ofthe image of the display object between the two adjacent video framesand saw by the eyes is smaller than certain threshold C (determinedaccording to an eye visual feature, a visual characteristic of a user,empirical data or the like) to ensure that the eyes cannot see thephenomena of picture judder, lag and trailing caused by movement of thedisplay object:

$\begin{matrix}{{s_{d} = {{Rs}_{0} = {{\frac{f}{d_{0}}s_{0}} = {\frac{fv}{d_{0}t} \leq C}}}}{{wherein},{R = \frac{f}{d_{0}}}}} & (3)\end{matrix}$

is a zooming factor, f is an equivalent focus length of the image of thedisplay object in certain video frame through the display device, d₀ isthe distance between the image of the display object in certain videoframe through the display device and the eyes (for example, pupils ofthe eyes), t is the refreshing rate of the display device (refreshingperiod is

$\left. \frac{1}{t} \right).$According to the displacement of the same display object between the twovideo frames, the expected refreshing information (for example, expectedrefreshing rate or period) of the formula (3) is met, the expectedrefreshing information and the refreshing capability information of thedisplay device are compared, if the expected refreshing informationexceeds the refreshing capability information of the display device (forexample the expected refreshing rate is larger than the maximalrefreshing rate of the display device, or the expected refreshing periodis smaller than the minimal refreshing period of the display device),then the interframe difference of the two adjacent video frames shouldmeet the preset condition, it is indicated that the probability that therefreshing capability of the display device insufficiently acquires abetter visual effect of the corresponding video frame is larger;otherwise, the interframe difference between the two adjacent videoframes cannot meet the preset condition, it is indicated that theprobability that the refreshing capability of the display device cansupport the corresponding video frame to acquire a better visual effectis larger.

If certain time window comprises three or more than three video frames,the above method can be adopted to respectively determine whether thedisplacement of the same display object between every two adjacent videoframes meets the preset condition, and a corresponding display imagedistance adjusting strategy is adopted according to a determiningresult, for example, the respective displacements of the same displayobject between the every two adjacent video frames respectively meet thecorresponding preset conditions, the local display image distance of atleast one video frame (for example, the display object of the at leastone video frame) can be increased to weaken the visual perception of theeyes to movement information of the same display object in the adjacentvideo frames by a manner of farther display of the corresponding videoframes, and realizing complexity of the solution is reduced as much aspossible in a manner of adjusting the local display image distance ofthe video frame; and/or at least one of the respective displacements ofthe same display object between every two adjacent video frames does notmeet the corresponding preset condition, the display image distance ofthe at least one video frame is kept unchanged to avoid the eye visualdiscomfort possibly caused by the frequent display image distanceadjusting, or the display image distance of the at least one video framecan be properly reduced to increase a visual immersion of the user tothe corresponding display content of the at least one video frame, orthe whole display image distance of the at least one video frame isadjusted by taking the video frame as a unit to improve the adjustingefficiency of the display image distance; etc.

Optionally, the video display control method also comprises: adjusting,responding to the expected refreshing information to not exceed therefreshing capability information, the refreshing information of thedisplay device according to the expected refreshing information and therefreshing capability information; and controlling the display device todisplay the at least one video frame according to the adjustedrefreshing information. If the expected refreshing information does notexceed the refreshing capability information of the display device, itis indicated that by the adaption of refreshing information of thedisplay device in a refreshing capability range of the display device,the probability that the display device smoothly displays correspondingvideo frame of the at least one display object is larger, the displaydevice is adjusted to display corresponding video frame with largerrefreshing rate, to cause the refreshing rate of the display devicedisplaying the corresponding video frame to be larger than or equal toor close to as much as possible the expected refreshing rate, in thisway, through simple adaption of the refreshing information of thedisplay device, the application demand of visual smooth display of theat least one display object relative to the eyes can be met, eye visualdiscomfort is relieved to some extent or even eliminated, a viewingeffect and user experience are improved, the solution is simple and easyto realize and solution universality is improved.

(22) The preset condition comprises: the displacement exceeds allowablemovement information corresponding to the refreshing capabilityinformation of the display device. In the solution, the display imagedistance of the same display object at different video frames can beadaptively adjusted by combining the movement information of the displayobject and the refreshing capability information, and the adjustingpertinence and effectiveness of the display image distance are improved.

It can be obtained through transformation of formula (3) that:

$\begin{matrix}{d_{0} \geq \frac{fv}{Ct}} & (4)\end{matrix}$

Size of the display image distance of the display object in certainvideo is:d _(s) =d ₀ −d _(e)  (5)

wherein, d_(s) is display image distance of certain video frame, andcontent of the video frame comprises certain display object; d_(e) isthe distance from the eyes to the display device (for example, thedistance from eye pupils to a lens optical center of the display deviceaffecting imaging of the display object, etc.). According to formula 4and formula 5, the allowable movement information corresponding to themaximal refreshing rate or minimal refreshing period of the displaydevice is determined, the allowable movement information is comparedwith the displacement of the same display object between two adjacentvideo frames, if the displacement is larger than allowable movementinformation, then the interframe difference between the two adjacentvideo frames meets the preset condition, it is indicated that theprobability that the refreshing capability of the display deviceinsufficiently acquires a better visual effect of the correspondingvideo frame is larger; otherwise, the interframe difference between thetwo adjacent video frames cannot meet the preset condition, it isindicated that the probability that the refreshing capability of thedisplay device can support the corresponding video frame to acquire abetter visual effect is larger.

If certain time window comprises three or more than three video frames,the above method can be adopted to respectively determine whether thedisplacement of the same display object between every two adjacent videoframes meets the preset condition, and a corresponding display imagedistance adjusting strategy is adopted according to a determiningresult, for example, the respective displacements of the same displayobject between the every two adjacent video frames respectively meet thecorresponding preset conditions, the local display image distance of atleast one video frame (for example, the display object of the at leastone video frame) can be increased to weaken the visual perception of theeyes to movement information of the same display object in the adjacentvideo frames by a manner of farther display of the corresponding videoframe, adjusting of the display image distance of the correspondingvideo frame can be performed according to limiting conditions of formula(4) and formula (5) to acquire a better visual effect, and the realizingcomplexity of the solution is reduced as much as possible in a manner ofadjusting the local display image distance of the video frame; and/or atleast one of the respective displacements of the same display objectbetween every two adjacent video frames does not meet the correspondingpreset condition, the display image distance of the at least one videoframe is kept unchanged to avoid the eye visual discomfort possiblycaused by the frequent display image distance adjusting, or the displayimage distance of the at least one video frame can be properly reducedto increase a visual immersion of the user to the corresponding displaycontent of the at least one video frame, or the whole display imagedistance of the at least one video frame is adjusted by taking the videoframe as a unit to improve the adjusting efficiency of the display imagedistance; etc.

Optionally, the video display control method also comprises: adjusting,responding to the displacement to not exceed the allowable movementinformation, the refreshing information of the display device accordingto the refreshing capability information; and controlling the displaydevice to display the at least one video frame according to the adjustedrefreshing information. If the displacement of the same display objectbetween the two adjacent video frames does not exceed the allowablemovement information, it is indicated to some extent that by theadaption of refreshing information of the display device in a refreshingcapability range of the display device, the probability that the displaydevice smoothly displays the corresponding video frame of the at leastone display object is larger, the display device is adjusted to displaycorresponding video frame with larger refreshing rate, in this way,through simple adaption of the refreshing information of the displaydevice, the application demand of visual smooth display of the at leastone display object relative to the eyes can be met, eye visualdiscomfort is relieved to some extent or even eliminated, a viewingeffect and user experience are improved, the solution is simple and easyto realize and solution universality is improved.

In the technical solution provided by the embodiment of the presentapplication, the display device comprises but is not limited to a lightfield display, a near-to-eye display, a 3D display, a projectiondisplay, a binocular display device and the like, which is not limitedby the embodiment of the present application. The imaging depth is to befelt by the binocular display device through binary disparity of leftand right eyes, thereby a user experiences a stereoscopic imagingeffect. In the situation of realizing the technical solution provided bythis embodiment of the present application, controlling the displaydevice to display the part of the at least one video frame at leastaccording to the local adjusted display image distance of the at leastone video frame comprises: according to the local adjusted display imagedistance of the at least one video frame, adjusting the binary disparityof the at least one video frame displayed by the binocular displaydevice; and controlling the binocular display device to display the partof the at least one video frame according to the local adjusted displayimage distance of the at least one video frame and the binary disparity.The display image distance of certain display object in certain videoframe and the binary disparity of the display object have certaincorresponding relation, if the display image distance and the binarydisparity are not matched, eye visual discomfort may be caused due tolarger difference between an actual accommodation distance and aconvergence distance. In the solution, the binary disparity of thedisplay object in the corresponding video frame is adjusted according tothe adjusted display image distance of the corresponding video frame,thereby, the visual discomfort of the user caused by the largerdifference between the actual accommodation distance and the convergencedistance due to the fact that the display image distance and the binarydisparity are not matched is reduced as much as possible, and the visualeffect and user experience are improved. Wherein, the binary disparityof the display object in the corresponding video frame can be determinedby adopting but not limited to following formula:

$\begin{matrix}{d = \frac{fB}{Z_{c}}} & (6)\end{matrix}$

wherein, d is the adjusted binary disparity of the display object in thevideo frame, f is equivalent focus length, B is distance between centersof left and right displays in the binocular display device, Z_(c) isbinocular convergence distance corresponding to the adjusted displayimage distance of the display object, wherein:

$\begin{matrix}{{{{\frac{1}{Z_{d}} - \frac{1}{Z_{c}}}} \leq n},{\frac{1}{3} \leq n \leq \frac{2}{3}}} & (7)\end{matrix}$

Z_(d) is the display image distance of the display object at thecorresponding video frame. In practical application, n is any numbermeeting the condition of

${\frac{1}{3} \leq n \leq \frac{2}{3}},$and an example embodiment is very flexible. Further, n can also bedetermined according to duration of display time of the display objectin the corresponding video frame, for example,

$n = \frac{1}{3}$so as to meet a diopter law to be met by the binocular 3D display, ifthe display time is shorter, then n can be increased, for example,

${n = \frac{2}{3}},$etc. The solution is simple and easy to realize and it is favorable toacquire a better visual effect.

Further, before binary disparity adjusting, the video display controlmethod also comprises: according to the local adjusted display imagedistance of the at least one video frame and the binocular convergencedistance corresponding to the binary disparity before adjusting of thedisplay object, determining whether triggering is required for binarydisparity adjusting, optionally, triggering judgment of the binarydisparity adjusting can be performed based on following formula:

$\begin{matrix}{{{{\frac{1}{Z_{d}} - \frac{1}{Z_{c}^{\prime}}}} \leq n},{\frac{1}{3} \leq n \leq \frac{2}{3}}} & (8)\end{matrix}$

Z_(c)′ is a known binocular convergence distance corresponding to thebinary disparity before adjusting of the display object. If the formula(8) holds, it is indicated that the difference between focusing and theconvergence distance caused by the adjusting of the display imagedistance of the display object falls in an allowable range of the eyes,and in this situation, adaptive adjusting of the binary disparity maynot be performed to reduce the realizing complexity of the solution asmuch as possible on the basis of realizing a better visual effect, ifformula (8) does not hold, it is indicated that the adjusting of thedisplay image distance of the display object may cause an uncomfortableviewing experience, this situation can trigger the adjusting of thebinary disparity, for example, the binary disparity (namely the adjustedbinocular disparity d) corresponding to the adjusted display imagedistance can be determined by formulas (7) and (6).

It may be understood by a person skilled in the art that, in any one ofthe foregoing methods of example embodiments of the present application,the value of the serial number of each step described above does notmean an execution sequence, and the execution sequence of the stepsshould be determined according to the function and internal logicalthereof, and should not constitute any limitation to the implementationprocedure of the example embodiments of the present application.

FIG. 2 is a logical block diagram of a video display control apparatusaccording to an embodiment of the present application. As shown in theFIG. 2, the video display control apparatus provided by the embodimentof the present application comprises: an interframe difference acquiringmodule 21, a display image distance adjusting module 22 and a firstdisplay control module 23.

The interframe difference acquiring module 21 is configured to acquireinterframe differences between every two adjacent frames in at least twoadjacent video frames in sequence of a video.

The display image distance adjusting module 22 is configured to adjust alocal display image distance of at least one video frame in the at leasttwo video frames according to respective interframe differences.

The first display control module 23 is configured to control the displaydevice to display a part of the at least one video frame at leastaccording to the local adjusted display image distance of the at leastone video frame.

According to the technical solutions provided by embodiments of thepresent application, association between an interframe differencebetween at least two adjacent video frames and a local display imagedistance of the video frame in a video is established, the local displayimage distance of the corresponding video frame is pertinently adjustedat least according to the interframe difference, and the part of thecorresponding video frame is displayed at least according to theadjusted display image distance, thereby a visual effect and userexperience are improved.

For example, in the technical solution provided by the embodiment of thepresent application, by a display manner of increasing a local displayimage distance of a corresponding video frame, uncomfortable visualperception of the user possibly caused by the overlarge local interframedifference can be weakened to certain extent, that is to say, the visualperception of the eyes to display effects such as a stuck screen, lag,judder or trailing possibly caused by the overlarge local interframedifference is weakened to certain extent by adjusting the display imagedistance, thereby a visual effect and user experience are improved.

For another example, in the technical solution provided by theembodiment of the present application, by a display manner of reducing alocal display image distance of a corresponding video frame, animmersive visual effect and experience of the user to the contentdisplayed by the display device in situations with smaller interframedifferent and the like can be adjusted.

There is no limit to the manners in which the video display controlapparatus is embodied. For example, the video display control apparatusmay be an independent part, and the part cooperates with a displaydevice in communication; or the video display control apparatus may be afunctional module integrated in a display device, etc., which is notlimited in this embodiment of the present application.

At least one video frame in the at least two video frames comprises anyvideo frame in the at least two video frames. Optionally, the at leastone video frame in the at least two video frames comprises: at least oneformer video frame in the at least two video frames and/or at least onelatter video frame in the at least two video frames; at least twoadjacent video frames in sequence in a video can comprise the situationof two adjacent video frames in the video and also comprise thesituation of three adjacent video frames in sequence or more than threevideo frames in the video; and an application range of the technicalsolution provided by the embodiment of the present application is verybroad.

Optionally, as shown in FIG. 3, the first display control module 23comprises: a zooming display control submodule 231. The zooming displaycontrol submodule 231 is configured to control the display device todisplay the part of the at least one video frame in a zooming manner atleast according to the local adjusted display image distance of the atleast one video frame. In the solution, adjustment of the display imagedistance in the depth direction of different parts of the video frameand the zooming display of the content of different parts of the videoframe are combined, which is favorable for fully using visual featuresof the eyes to reduce as much as possible or eliminate the eye visualdiscomfort caused by display change in the depth direction.

Optionally, the zooming display control submodule 231 comprises: azooming in display control unit 2311. The zooming in display controlunit 2311 is configured to control the display device to display thepart of the at least one video frame in a zooming in manner at leastaccording to the local adjusted display image distance of the at leastone video frame, wherein the local adjusted display image distance ofthe at least one video frame is larger than the display image distancebefore adjusting. In the solution, the local farther display of the atleast one video frame and the local zooming in display are combined, onone aspect, the eye visual discomfort possibly caused by the overlargelocal interframe difference of every two adjacent video frames isweakened or even offset by a manner of local farther display of the atleast one video frame, on the other aspect, by using anear-large-far-small eye visual feature, by zooming in display of thevisual effect, that the at least one video frame is closer to the eyes,caused to the eyes, visual perception of the eyes in the depth directioncaused by actual local farther display of the at least one video frameis relieved to certain extent or even offset, thereby the visualdiscomfort possibly caused by the adjusting of the local display imagedistance is relieved or even eliminated, and further it is favorable forimproving visual effect and user experience.

Optionally, the zooming display control submodule 231 comprises: azooming out display control unit 2312. The zooming out display controlunit 2312 is configured to control the display device to display thepart of the at least one video frame in a zooming out manner at leastaccording to the local adjusted display image distance of the at leastone video frame, wherein the local adjusted display image distance ofthe at least one video frame is smaller than the display image distancebefore adjusting. In the solution, the local closer display of the atleast one video frame and the local zooming out display are combined, onone aspect, a visual immersing feeling of the corresponding video framecontent displayed by the display device is increased in a manner oflocal closer display of the at least one video frame, and visual effectand user experience are improved, on the other aspect, by using anear-large-far-small eye visual feature, by zooming out display of thevisual effect, that the part of the at least one video frame is fartheraway from the eyes, caused to the eyes, the visual perception of theeyes in the depth direction caused by actual local closer display of theat least one video frame is relieved to certain extent or even offset,thereby the visual discomfort possibly caused by the adjusting of thedisplay image distance is relieved or even eliminated, and further it isfavorable for improving the visual effect and user experience.

Optionally, the zooming display control submodule 231 comprises: azooming ratio parameter determining unit 2313 and a zooming displaycontrol unit 2314. The zooming ratio parameter determining unit 2313 isconfigured to determine a local zooming ratio parameter of the at leastone video frame according to the display image distance before and afterlocal adjusting of the at least one video frame; the zooming displaycontrol unit 2314 is configured to control the display device to displaythe part of the at least one video frame according to the local adjusteddisplay image distance of the at least one video frame and the zoomingratio parameter. In the solution, the zooming ratio parameter of thelocal display of the video frame is determined in combination with thedisplay image distance before and after local adjusting of the videoframe, and zooming display control is performed accordingly, thereby,the visual discomfort possibly caused by the adjusting of the displayimage distance is relieved or even eliminated, and it is favorable forimproving visual effect and user experience

The display device comprises but is not limited to a light fielddisplay, a near-to-eye display, a 3D display, a projection display, abinocular display device and the like, which is not limited by theembodiment of the present application. The imaging depth is felt by thebinocular display device through binary disparity of left and righteyes, thereby a user experiences a stereoscopic imaging effect. In thesituation of realizing the technical solution provided by thisembodiment of the present application, the first display control module23 comprises: a binary disparity determining submodule 232 and a binarydisparity display control submodule 233. The binary disparitydetermining submodule 232 is configured to according to the localadjusted display image distance of the at least one video frame, adjustthe local binary disparity of the at least one video frame displayed bythe binocular display device; and the binary disparity display controlsubmodule 233 is configured to control the binocular display device todisplay the part of the at least one video frame according to the localadjusted display image distance of the at least one video frame and thebinary disparity. In the solution, the binary disparity of the displayobject in the corresponding video frame is adjusted according to theadjusted display image distance of the corresponding video frame,thereby, the visual discomfort of the user caused by the largerdifference between an actual accommodation distance and a convergencedistance due to the fact that the display image distance and the binarydisparity are not matched is reduced as much as possible, and the visualeffect and user experience are improved.

As shown in FIG. 4, the display image distance adjusting module 22comprises: a display image distance adjusting submodule 221. The displayimage distance adjusting submodule 221 is configured to control thebinocular display device to display the part of the at least one videoframe according to the local adjusted display image distance of the atleast one video frame and the binary disparity. The solution isequivalent to that in a practical display process, the part of thecorresponding video frame is displayed at certain position farther awayfrom the display image distance before adjusting, thereby by using thefeature that the eyes have lower visual resolution for a farther displaycontent, the uncomfortable perception possibly caused when the eyes seethe corresponding local content is weakened, thereby a viewing effectand user experience are improved. If the at least one interframedifference in respective interframe differences does not meet the presetcondition, then it is indicated that the change tendency of the videocontent in the time window along with time is not stable, then the localdisplay image distance of the corresponding video frame may not beadjusted, thereby the eye visual discomfort possibly caused by thefrequent adjusting of the display image distances of different videoframes in a period of time is avoided.

Optionally, the interframe difference between any two adjacent videoframes in the at least two video frames comprises: optical parameterdifference of pixels at multiple corresponding positions in the twoadjacent video frames; and the part of the at least one video framecomprises: at least one region, in which pixels with the opticalparameter difference exceeding an optical parameter threshold aredistributed, in a video frame. The optical parameter difference of thepixels at multiple corresponding positions reflects the interframedifference between the two adjacent video frames to certain extent, andthe optical parameter difference is easier to capture and quantify,thereby, realizing complexity of the solution is favorably reduced.Optionally, the optical parameters comprise at least one of following: apixel number of the optical parameter difference exceeding an opticalparameter threshold is smaller than a pixel number threshold; a firstspecific value of the pixel number of the optical parameter differenceexceeding an optical parameter threshold to the total number of thesingle frame pixels is smaller than a pixel ratio threshold; anon-continuously distributed region number of pixels of the opticalparameter difference exceeding an optical parameter threshold is smallerthan a region number threshold; a continuously distributed maximalregion area of the pixels of the optical parameter difference exceedingan optical parameter threshold is smaller than an area threshold; and asecond specific value of the continuously distributed maximal regionarea of the pixels of the optical parameter difference exceeding anoptical parameter threshold to a single frame total area is smaller thanan area ratio threshold. Above respective preset conditions can beindependently used respectively, and can be combined for use to bettercapture and quantify the interframe difference of two adjacent videoframes, and a realizing manner is very flexible.

Optionally, the interframe difference between any two adjacent videoframes in the at least two video frames comprises: displacement of theat least one display object between the two adjacent video frames; andthe part of the at least one video frame comprises: the at least onedisplay object in the at least one video frame. In the solution, throughthe displacement of the same display object between the two adjacentvideo frames, the movement information of the display object isconvenient to capture and quantify, thereby realizing complexity of thesolution is favorably reduced.

In one optimal realizing manner, the preset condition comprises:expected refreshing information corresponding to displacement exceedsthe refreshing capacity information of the display device. In thesolution, movement information of a display object and the refreshingcapability information are combined to adapt to the display imagedistance of the same display object at different video frames, andimprove adjusting pertinence and effectiveness of the display imagedistance. Further optionally, in this situation, the apparatus alsocomprises a first refreshing information determining module 24 and asecond display control module 25. The first refreshing informationdetermining module 24 is configured to adjust, responding to theexpected refreshing information to not exceed the refreshing capabilityinformation, the refreshing information of the display device accordingto the expected refreshing information and the refreshing capabilityinformation; and the second display control module 25 is configured tocontrol the display device to display the at least one video frameaccording to the adjusted refreshing information. In the solution,through simple adaption of the refreshing information of the displaydevice, the application demand of visual smooth display of the at leastone display object relative to the eyes can be met, eye visualdiscomfort is relieved to some extent or even eliminated, a viewingeffect and user experience are improved, the solution is simple and easyto realize and solution universality is improved.

In another optional realizing manner, the preset condition comprises:the displacement exceeds allowable movement information corresponding tothe refreshing capability information of the display device. In thesolution, the display image distance of the same display object atdifferent video frames can be adaptively adjusted by combining themovement information of the display object and the refreshing capabilityinformation, and the adjusting pertinence and effectiveness of thedisplay image distance are improved. Further optionally, in thissituation, the apparatus also comprises a second refreshing informationdetermining module 23 and a third display control module 27. The secondrefreshing information determining module 26 is configured to adjust,responding to the displacement to not exceed the allowable movementinformation, the refreshing information of the display device accordingto the refreshing capability information; and the third display controlmodule 27 is configured to control the display device to display the atleast one video frame according to the adjusted refreshing information.In the solution, through simple adaption of the refreshing informationof the display device, the application demand of visual smooth displayof the at least one display object relative to the eyes can be met, eyevisual discomfort is relieved to some extent or even eliminated, aviewing effect and user experience are improved, the solution is simpleand easy to realize and solution universality is improved.

FIG. 5 is a structural block diagram of a display device according to anembodiment of the present application, and an example embodiment of thedisplay control device 500 is not limited by a specific embodiment ofthe present application. As shown in FIG. 5, the display device 500 maycomprise:

a processor 510, a communication interface 520, a memory 530 and acommunication bus 540, wherein,

the processor 510, the communication interface 520, and the memory 530communicate with one another by the communication bus 540.

The communication interface 520 is configured to communicate with anexternal device with a communication function.

The processor 510 is configured to execute a program 532, andspecifically execute related steps in the embodiments of any method.

For example, the program 532 may comprise a program code, and theprogram code comprises at least one computer operation command.

The processor 510 may be a central processing unit (CPU), or anapplication specific integrated circuit (ASIC) or configured toimplement one or more integrated circuits of the embodiments of thepresent application.

The memory 530 is configured to store the program 532. The memory 530may comprise a random access memory (RAM), and may also comprise anon-volatile memory, such as at least one disk memory. For example, inone example embodiment, the processor 510 can execute the followingsteps by executing the program 532: acquiring interframe differencesbetween every two adjacent frames in at least two adjacent video framesin sequence of a video; adjusting a local display image distance of atleast one video frame in the at least two video frames according torespective interframe differences; and displaying the part of the atleast one video frame at least according to the local adjusted displayimage distance of the at least one video frame. In other exampleembodiments, the processor 510 can execute the steps mentioned in anyother embodiment by executing the program 532, which is not repeatedherein.

Specific implementation of each step in the program 532 refers to thecorresponding description of corresponding steps, modules, submodulesand units in foregoing embodiments, which is not repeated herein. Aperson of ordinary skill in the art can clearly understand that forconvenient and brief description, a specific work process of theforegoing devices and modules may refer to the corresponding processdescription in the embodiments of the methods, which is not repeatedherein.

In the foregoing embodiments of the present application, the serialnumber and/or sequence of the embodiments are only intended for theconvenience of description, and do not represent inferiority orsuperiority of the embodiments. The description of each embodiment has adifferent focus. For any part of an embodiment not described in details,refer to relevant description of another embodiment. For relevantdescription of the implementation principle or process of apparatus,device or system embodiments, refer to records of relevant methodembodiments, and the details are not described herein again.

A person of ordinary skill in the art may recognize that, the units,methods and procedures of each example described with reference to theembodiments disclosed herein, can be implemented by electronic hardwareor a combination of computer software and electronic hardware. Whetherthe functions are performed by hardware or software depends onparticular applications and design constraint conditions of thetechnical solutions. A person skilled in the art may use differentmethods to implement the described functions for each particularapplication, but it should not be considered that the implementationgoes beyond the scope of the present application.

When the functions are implemented in a form of a software functionalunit and sold or used as an independent product, the functions may bestored in a computer-readable storage medium. Based on such anunderstanding, the technical solutions of the present applicationessentially, or a part thereof contributing to the existing art, or apart of the technical solutions may be implemented in the form of asoftware product. The computer software product is stored in a storagemedium and comprises several instructions for instructing a computerdevice (which may be a personal computer, a server, a network device, orthe like) to perform all or some of the steps of the display controlmethods in the embodiments of the present application. The foregoingstorage medium comprises: any medium that can store program code, suchas a USB flash drive, a removable hard disk, a read-only memory (ROM forshort), a random access memory (RAM for short), a magnetic disk, or anoptical disc.

In the apparatus, method and system embodiments of the presentapplication, apparently, each component (such as a system, a sub-system,a module, a sub-module, a unit, and a sub-unit) or each step may bedecomposed, combined and/or recombined after decomposition. Suchdecomposition and/or recombination shall be considered as an equivalentsolution of the present application. In addition, in the abovedescription of specific embodiments of the present application, afeature described and/or shown in one example embodiment may be used inone or more other example embodiments by using a same or similar manner,combined with a feature of another example embodiment, or replace afeature of another example embodiment.

It should be emphasized that, the term “comprise” used herein refers toexistence of a feature, an element, a step or a component, but does notexclude existence or addition of one or more other features, elements,steps or components.

Finally, it should be noted that, the above example embodiments are onlyused to describe the present application, rather than limit the presentapplication. Various alterations and variants may also be made by aperson of ordinary skill in the art without departing from the spiritand scope of the present application. Therefore, all equivalenttechnical solutions also belong to the scope of the present application,and the patent protection scope of the present application should besubject to the claims.

What is claimed is:
 1. A method, comprising: acquiring, by a systemcomprising a processor, respective interframe differences between everytwo adjacent frames of a plurality of video frames in a sequence of avideo, wherein the respective interframe differences between every twoadjacent video frames indicate respective difference degrees of thedisplay content corresponding to the two adjacent video frames;adjusting a display image distance of a part of at least one video frameof the plurality of video frames according to the respective interframedifferences resulting in an adjusted display image distance of the partof the at least one video frame, wherein the display image distance ofthe part of the at least one video frame is a distance between anoptical part of the display device and an image of the least one videoframe displayed through the optical part; and controlling a displaydevice to display the part of the at least one video frame at leastaccording to the adjusted display image distance.
 2. The method of claim1, wherein the at least one video frame comprises: at least one formervideo frame of the plurality of video frames.
 3. The method of claim 1,wherein the at least one video frame comprises: at least one lattervideo frame of the plurality of video frames.
 4. The method of claim 1,wherein the controlling the display device to display the part of the atleast one video frame at least according to the adjusted display imagedistance comprises: controlling the display device to display the partof the at least one video frame in a zooming manner at least accordingto the adjusted display image distance.
 5. The method of claim 4,wherein the adjusted display image distance is larger than the displayimage distance before the adjusting.
 6. The method of claim 4, whereinthe adjusted display image distance is smaller than the display imagedistance before the adjusting.
 7. The method of claim 4, wherein thecontrolling the display device to display the part of the at least onevideo frame in the zooming manner at least according to the adjusteddisplay image distance comprises: determining a local zooming ratioparameter of the at least one video frame according to the display imagedistance before the adjusting and the adjusted display image distanceafter the adjusting; and controlling the display device to display thepart of the at least one video frame according to the adjusted displayimage distance of the at least one video frame and the zooming ratioparameter.
 8. The method of claim 1, wherein the display devicecomprises a binocular display device, and wherein the controlling thedisplay device to display the part of the at least one video frame atleast according to the adjusted display image distance comprises:according to the adjusted display image distance, adjusting a localbinary disparity of the at least one video frame displayed by thebinocular display device; and controlling the binocular display deviceto display the part of the at least one video frame according to theadjusted display image distance and the binary disparity.
 9. The methodof claim 1, wherein the adjusting the display image distance comprises:in response to the respective interframe differences being determined tomeet a preset condition respectively, adjusting the display imagedistance to cause the adjusted display image distance to be larger thanthe display image distance before the adjusting.
 10. The method of claim1, wherein an interframe difference between two adjacent video frames ofthe plurality of video frames comprises: an optical parameter differenceof pixels at multiple corresponding positions in the two adjacent videoframes, and wherein the part of the at least one video frame comprises:at least one region, in which pixels with the optical parameterdifference exceeding an optical parameter threshold are distributed, inthe at least one video frame.
 11. The method of claim 10, wherein theoptical parameter comprises at least one of: brightness, chroma orsaturated degree.
 12. The method of claim 10, further comprising:determining whether the respective interframe differences meet a presetcondition, wherein the preset condition comprises at least one of: apixel number of the optical parameter difference exceeding a firstoptical parameter threshold is smaller than a pixel number threshold, afirst specific value of the pixel number of the optical parameterdifference exceeding a second optical parameter threshold to a totalnumber of single frame pixels is smaller than a pixel ratio threshold, anon-continuously distributed region number of pixels of the opticalparameter difference exceeding a third optical parameter threshold issmaller than a region number threshold; a continuously distributedmaximal region area of the pixels of the optical parameter differenceexceeding a fourth optical parameter threshold is smaller than an areathreshold; and a second specific value of the continuously distributedmaximal region area of the pixels of the optical parameter differenceexceeding a fifth optical parameter threshold to a single frame totalarea is smaller than an area ratio threshold.
 13. The method of claim 1,wherein an interframe difference between two adjacent video frames ofthe plurality of video frames comprises: a displacement of at least onedisplay object between the two adjacent video frames; and the part ofthe at least one video frame comprises: the at least one display objectin the at least one video frame.
 14. The method of claim 13, furthercomprising: determining whether the respective interframe differencesmeet a preset condition, wherein the preset condition comprises:expected refreshing information corresponding to displacement exceedsrefreshing capacity information of the display device.
 15. The method ofclaim 14, further comprising: in response to the expected refreshinginformation being determined not to exceed the refreshing capacityinformation, adjusting refreshing information of the display deviceaccording to the expected refreshing information and the refreshingcapacity information, resulting in adjusted refreshing information; andcontrolling the display device to display the at least one video frameaccording to the adjusted refreshing information.
 16. The method ofclaim 13, further comprising: determining whether the respectiveinterframe differences meet a preset condition, wherein the presetcondition comprises: the displacement exceeds allowable movementinformation corresponding to the refreshing capacity information of thedisplay device.
 17. The method of claim 16, further comprising: inresponse to the displacement being determined not to exceed theallowable movement information, adjusting the refreshing information ofthe display device according to the refreshing capacity information,resulting in adjusted refreshing information; and controlling thedisplay device to display the at least one video frame according to theadjusted refreshing information.
 18. An apparatus, comprising: a memorythat stores executable modules; and a processor, coupled to the memory,that executes or facilitates execution of the executable modules, theexecutable modules comprising: an interframe difference acquiring moduleconfigured to acquire respective interframe differences between everytwo adjacent frames of a plurality of video frames in sequence of avideo, wherein the respective interframe differences between every twoadjacent video frames indicate respective difference degrees of thedisplay content corresponding to respective pairs of every two adjacentvideo frames; a display image distance adjusting module configured toadjust a display image distance of a part of at least one video frame ofthe plurality of video frames according to the respective interframedifferences, resulting in an adjusted display image distance of the partof the at least one video frame, wherein the display image distance ofthe part of the at least one video frame is a distance between anoptical part of the display device and an image of the at least onevideo frame displayed through the optical part; and a first displaycontrol module configured to control the display device to display thepart of the at least one video frame at least according to the adjusteddisplay image distance of the at least one video frame.
 19. Theapparatus of claim 18, wherein the at least one video frame comprises:at least one former video frame of the plurality of video frames. 20.The apparatus of claim 18, wherein the at least one video framecomprises: at least one latter video frame of the plurality of videoframes.
 21. The apparatus of claim 18, wherein the first display controlmodule comprises: a zooming display control submodule configured tocontrol the display device to display the part of the at least one videoframe in a zooming manner at least according to the adjusted displayimage distance of the at least one video frame.
 22. The apparatus ofclaim 21, wherein the adjusted display image distance is larger than thedisplay image distance before the adjusting.
 23. The apparatus of claim21, wherein the adjusted display image distance is smaller than thedisplay image distance before the adjusting.
 24. The apparatus of claim21, wherein the zooming display control submodule comprises: a zoomingratio parameter determining unit configured to determine a zooming ratioparameter of the part of the at least one video frame according to thedisplay image distance before the adjusting and the adjusted displayimage distance after the adjusting; and a zooming display control unitconfigured to control the display device to display the part of the atleast one video frame according to the adjusted display image distanceof the at least one video frame and the zooming ratio parameter.
 25. Theapparatus of claim 18, wherein the display device comprises: a binoculardisplay device, and wherein the first display control module comprises:a binary disparity determining submodule configured to, according to theadjusted display image distance, adjust a binary disparity of the partof the at least one video frame displayed by the binocular displaydevice; and a binary disparity display control submodule configured tocontrol the binocular display device to display the part of the at leastone video frame according to the adjusted display image distance and thebinary disparity.
 26. The apparatus of claim 25, wherein the displayimage distance adjusting module comprises: a display image distanceadjusting submodule configured to control the binocular display deviceto display the part of the at least one video frame according to theadjusted display image distance and the binary disparity.
 27. Theapparatus of claim 18, wherein an interframe difference between twoadjacent video frames of the plurality of video frames comprises: anoptical parameter difference of pixels at multiple correspondingpositions in the two adjacent video frames, and wherein the part of theat least one video frame comprises: at least one region, in which pixelswith the optical parameter difference exceeding an optical parameterthreshold are distributed, in the at least one video frame.
 28. Theapparatus of claim 27, wherein the optical parameter comprises at leastone of: brightness, chroma or saturated degree.
 29. The apparatus ofclaim 27, wherein the interframe difference acquiring module is furtherconfigured to determine whether the respective interframe differencesmeet a preset condition, and wherein the preset condition comprises atleast one of: a pixel number of the optical parameter differenceexceeding a first optical parameter threshold is smaller than a pixelnumber threshold, a first specific value of the pixel number of theoptical parameter difference exceeding a second optical parameterthreshold to a total number of single frame pixels is smaller than apixel ratio threshold, a non-continuously distributed region number ofpixels of the optical parameter difference exceeding a third opticalparameter threshold is smaller than a region number threshold, acontinuously distributed maximal region area of the pixels of theoptical parameter difference exceeding a fourth optical parameterthreshold is smaller than an area threshold, and a second specific valueof the continuously distributed maximal region area of the pixels of theoptical parameter difference exceeding a fifth optical parameterthreshold to a single frame total area is smaller than an area ratiothreshold.
 30. The apparatus of claim 18, wherein an interframedifference between two adjacent video frames of the plurality of videoframes comprises: displacement of the at least one display objectbetween the two adjacent video frames; and the part of the at least onevideo frame comprises: the at least one display object in the at leastone video frame.
 31. The apparatus of claim 30, wherein the interframedifference acquiring module is further configured to determine whetherthe respective interframe differences meet a preset condition, andwherein the preset condition comprises: expected refreshing informationcorresponding to the displacement exceeds refreshing capacityinformation of the display device.
 32. The apparatus of claim 31,wherein the executable modules further comprise: a first refreshinginformation determining module configured to adjust, responsive to theexpected refreshing information being determined not to exceed therefreshing capacity information, refreshing information of the displaydevice according to the expected refreshing information and therefreshing capability information, resulting in adjusted refreshinginformation; and a second display control module configured to controlthe display device to display the at least one video frame according tothe adjusted refreshing information.
 33. The apparatus of claim 30,wherein the interframe difference acquiring module is further configuredto determine whether the respective interframe differences meet a presetcondition, and wherein the preset condition comprises: the displacementexceeds allowable movement information corresponding to the refreshingcapacity information of the display device.
 34. The apparatus of claim33, wherein the executable modules further comprise: a second refreshinginformation determining module configured to adjust, responsive to thedisplacement being determined not to exceed the allowable movementinformation, refreshing information of the display device according tothe refreshing capacity information, resulting in adjusted refreshinginformation; and a third display control module configured to controlthe display device to display the at least one video frame according tothe adjusted refreshing information.
 35. A display device, comprising: aprocessor, a communication interface, a memory and a communication bus,wherein the processor, the communication interface, and the memorycommunicate with one another by the communication bus, and wherein thememory is configured to store at least one command; the command causesthe processor to execute operations, comprising: acquiring respectiveinterframe differences between every two adjacent frames of a pluralityof video frames in a sequence of a video, wherein the respectiveinterframe differences between every two adjacent video frames indicaterespective difference degrees of the display content corresponding torespective pairs of two adjacent video frames; adjusting a display imagedistance of a part of at least one video frame of the plurality of videoframes the respective interframe differences resulting in an adjusteddisplay image distance of the part of the at least one video frame,wherein the display image distance of the part of the at least one videoframe is a distance between an optical part of the display device and animage of the at least one video frame displayed through the opticalpart; and displaying the part of the at least one video frame at leastaccording to the adjusted display image distance.
 36. A non-transitorycomputer readable medium having instructions stored thereon that, inresponse to execution, cause a system comprising a processor to performoperations comprising: acquiring respective interframe differencesbetween every two adjacent frames of a plurality of video frames in asequence of a video, wherein the respective interframe differencesbetween every two adjacent video frames indicate difference degree ofthe display content corresponding to respective two adjacent videoframes of every two adjacent video frames; adjusting a display imagedistance of a part of a video frame of the plurality of video framesaccording to the respective interframe differences resulting in anadjusted display image distance of the part of the video frame, whereinthe display image distance of the part of the video frame is a distancebetween an optical part of the display device and an image of the videoframe displayed through the optical part; and controlling the displaydevice to display the part of the video frame at least according to theadjusted display image distance.